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Method for the optical inspection of a transparent protective layer 
and of a colored patterned surface 



The present invention relates to a method for the optical inspection of a trans- 
parent protective layer and of a colored patterned surface, whereby the transparent 
protective layer at least partially covers the colored patterned surface, said method 
using a first source of illumination as well as an imaging sensor associated with 
5 the first source of illumination. 

The present invention also relates to an arrangement for the optical inspection 
of a transparent protective layer and of a colored patterned surface, in which the 
transparent protective layer at least partially covers the colored patterned surface, 
which comprises a first source of illumination whose emission spectrum encom- 
10 passes shortwaved visible light, as well as an imaging sensor associated with the 
first source of illumination. 

The automatic optical inspection of smooth, multi-colored surfaces using spe- 
cial cameras, illumination means and pattern-recognition as well as image- 
processing computers is already known from many production sectors such as, for 
1 5 example, the ceramics industry or the wood industry. 

It is likewise a known procedure to detect these surfaces simultaneously using 
different cameras and illumination systems so as to recognize esthetic defects in 
the coloration (contamination, color discrepancies, etc.) as well as physical defects 
on the surface (lumps, scratches, irregularities, gloss defects). A typical technique 
20 is detection with one or more color cameras under diffuse incident illumination 
and with one or more separate black-and-white cameras that pick up light from a 
source of illumination that is directed onto and reflected off the surface. 
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German patent specification DE 196 09 045 CI describes a refinement to a so- 
called multi-sensorial camera for the inspection of wooden specimens in which 
the various cameras and sources of illumination no longer observe the surface at 
different places but rather, they use a shared lens system to scan the same place on 
5 the surface that is illuminated by different sources of illumination and observed by 
different image sensors that are each associated with respective sources of 
illumination. 

The optical checking has the objective not only of segregating defective prod- 
ucts or of assigning the products to certain quality classes, but also of displaying 
10 the different defect classes, in order to provide the machine operator with the 
information he needs to adjust the production process so as to reduce the defects. 
For this purpose, it is necessary not only to detect the defects but also to classify 
them, that is to say, to identify the detected defects. 

The prior-art systems, however, are not capable of achieving this objective 
15 satisfactorily in the case of surfaces having single-colored or multi-colored pat- 
terns that are provided with a transparent protective layer. These include, for 
example, multi-colored laminate floor coverings in which a decoratively printed 
film with a wood grain, stone pattern or other decor is laid onto a substrate made 
of fiberboard and then one or more transparent, so-called overlay films are applied 
20 onto this film. These overlay films can be made, for example, of a mixture or 
melamine and corundum and they ensure the friction-resistance, hardness and 
water-tightness of the floor covering. 

There are also laminate floors where a multi-colored printed plastic film is 
applied onto a plastic substrate and this arrangement, in turn, is provided with one 
25 or more transparent but strong protective layers. Likewise known are surfaces 
where the transparent protective layer is applied in liquid form and then hardens. 
Below, all of these surfaces will be combined under the general term "laminates". 

The optical inspection is rendered more difficult due to the fact that many 
laminate floors are provided with an embossed structure in order to simulate the 
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surface properties of natural materials such as wood and natural stone. As a result, 
the surface of the protective layer is no longer smooth. 

When it comes to these laminates, the known arrangements for optical inspec- 
tion of the transparent protective layers and of colored patterned surfaces using 
5 color cameras and associated diffuse incident illumination as well as black-and- 
white cameras that pick up the reflected light from a directed source of incident 
illumination are limited to the recognition of color defects and mismatches in the 
decor as well as to the recognition of the physical defects in the transparent pro- 
tective layer. 

10 However, these arrangements are not capable of recognizing slight defects 

inside the transparent protective layer and of identifying them as such. 

The undirected reflection of the diffuse incident illumination is markedly 
modulated by the colored decor film, but hardly by typical defects inside the 
transparent protective layer such as, for example, slight milkiness or localized 

15 tears in the protective layer. Although a mild milky transparency slightly changes 
the saturation of the color decors that are to be inspected, due to the efforts to 
make the decor look as realistic as possible, the decor prints have a wide band- 
width of saturation values, so that a weak saturation caused by the milkiness of the 
protective layer cannot be distinguished from the intentional saturation differences 

20 that are present in the decor print. 

The black-and-white camera that picks up the light from a directed source of 
incident illumination that is reflected off the surface can detect local defects in the 
gloss and in the integrity of the surface. However, this illumination hardly pene- 
trates into the transparent protective layer and is thus changed only slightly or not 
25 at all as a result of defects inside the protective layer. Moreover, many laminate 
floor coverings are produced mechanically with surface patterns that are 
embossed into the protective layer. In this case, a camera system that observes by 
means of reflection is virtually unable to detect defects inside the protective layer. 




Even major defects in the protective layer such as, for example, complete local 
tears in the transparent protective layer, are not reliably recognized. 

Therefore, the known systems for optical inspection of laminates can only 
detect some of the production defects and then they can only insufficiently iden- 
5 tify the detected production defects. In view of the large quantities of surfaces 
produced worldwide, there is great economic interest in a method for the optical 
inspection of surfaces by means of which - in addition to the defects in the decor 
and on the surface of the transparent protective layer - defects inside the trans- 
parent protective layer can also be reliably recognized at the same time. 

10 According to the present invention, in order to recognize defective places 

inside and beneath the transparent protective layer, the protective layer is illumi- 
nated with the light emitted by the source of illumination, whereby the source of 
illumination emits light in the shortwaved visible range and the light striking the 
surface penetrates at least partially into the protective layer and is scattered at the 

15 defective places. Light scattered back from the defective places is picked up by 
the imaging sensor and the defective places are recognized by the local increase in 
the intensity of the light picked up by the imaging sensor in the area of the defec- 
tive places. The shorter the wavelength of the light, the larger the fraction of the 
light scattered at the defective places, so that a source of illumination is selected 

20 whose emission spectrum encompasses the shortwaved visible range. In this man- 
ner, defective places inside the protective layer can be reliably recognized. 

In order to minimize the influence of the embossing of the surface, according 
to a preferred embodiment of the method, the source of illumination and the 
imaging sensor associated with the source of illumination are arranged perpen- 
25 dicularly above the surface of the transparent protective layer. 

In accordance with another preferred embodiment of the method according to 
the invention, a second source of illumination is provided that emits light at a first 
wavelength that excites the protective layer to fluoresce with light at a second 
wavelength that is different from the first wavelength. The fluorescent light is 
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picked up by an imaging sensor associated with the second source of illumination. 
Defective places in the transparent protective layer are then recognized on the 
basis of local changes in the intensity of the fluorescent light since, for example, 
in areas where there is no protective layer at all, no fluorescent light is picked up 
5 by the imaging sensor. In order to pick up the fluorescent light, the imaging sensor 
associated with the second source of illumination preferably has greater sensitivity 
in the wavelength range of the second wavelength than in the wavelength range of 
the first wavelength. As a result, when the imaging sensor is, for example, a 
black-and-white camera, places with an intact protective layer appear brighter 
10 than places where there is no protective layer. 

According to another preferred embodiment of the method, the same source of 
illumination is employed in order to excite the fluorescent light and to recognize 
defective places inside the transparent protective layer by means of the scatter at 
the defective places. For instance, so-called black-light lamps, which have an 

15 ultraviolet fraction that excites the fluorescence of the protective layer and which 
also emit a shortwaved visible fraction, can be employed to illuminate the material 
to be inspected. In this manner, a single source of illumination and a single cam- 
era can use the localized higher scatter to recognize the milkiness defects as bright 
colored image places inside the transparent protective layer, and they can use the 

20 localized absence of fluorescence to recognize the localized absence of the trans- 
parent protective layer as dark image places on the overall slightly bright back- 
ground. 

In another preferred embodiment of the method, color-capable imaging sen- 
sors are employed in addition to the imaging sensor(s) that pick up the fluorescent 

25 light or the back-scattered light, whereby said color-capable imaging sensors 
detect color defects in the colored patterned surface that is at least partially cov- 
ered by the transparent protective layer. In addition to this, in order to detect 
defects on the surface of the transparent protective layer, a third source of illumi- 
nation can be provided which emits a directed beam of light that is reflected off 

30 the surface of the protective layer and that is picked up by an imaging sensor 
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associated with the third source of illumination. Defects on the surface can then be 
recognized on the basis of local changes in the intensity of the reflected light 
picked up by the imaging sensor. As a result, all of the defects on the surface of 
the protective layer can be detected that either reflect the illuminating beam of 
5 light at an angle other than the angle of incidence (for instance, bumps or dents) or 
that reflect the beam of light at the same angle but with a different intensity (for 
example, places that are locally too dull or too glossy). 

The present invention also provides an arrangement for the optical inspection 
of surfaces with which defects inside the transparent protective layer can be relia- 
10 bly recognized. 

In accordance with the arrangement according to the invention, there is a first 
source of illumination whose emission spectrum encompasses shortwaved visible 
light and an imaging sensor associated with the first source of illumination, 
whereby the imaging sensor picks up light scattered back from the defective 
15 places inside and beneath the transparent protective layer, and whereby the imag- 
ing sensor can recognize the defective places on the basis of the local increase in 
the intensity of the light picked up by the imaging sensor in the area of the defec- 
tive places. 

Additional features and advantages of the invention can be gleaned from the 
20 subordinate claims as well as from the description below of several preferred 
embodiments which are depicted in the accompanying drawings. These show the 
following: 

Figure 1 schematically shows an arrangement comprising a color line camera, 
diffuse incident illumination and a black-and-white line camera that picks up the 
25 reflected light coming from a directed source of illumination. 

Figure 2 schematically depicts a cross section through an embossed laminate 
floor covering provided with a transparent protective layer in order to show that 
defects inside the protective layer cannot be detected either by the so-called 
reflection channel or by the so-called color channel. 
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Figure 3 shows, by way of an example, that slight milkiness defects inside the 
embossed, transparent protective layer are detected if the latter is diffusely illumi- 
nated with shortwaved light and the scattered light is picked up by an imaging 
technique. 

5 Figure 4 shows, by way of an example, that local tears in the transparent pro- 

tective layer can be detected by imaging on the basis of the localized absence of 
fluorescence on the surface illuminated with radiation near the UV spectrum, 
without the mechanical embossing interfering with the recognition. 

Figure 5 schematically shows the emission spectrum of a source of illumina- 
10 tion by means of which the transparent protective layer can be simultaneously 
excited to fluorescence and defects inside the transparent protective layer can be 
detected through the wavelength-dependent scatter at scatter centers inside the 
protective layer, together with the sensitivity characteristic line of the associated 
imaging sensor. 

15 Figures 6a and 6b show, by way of an example, how to optically insulate the 

various sources of illumination from the cameras associated with the sources of 
illumination, once through shielding and once through a different spectral con- 
figuration of the wavelength range of the so-called reflection channel and of the 
so-called "overlay channel". 

20 Hereinafter, the term "color channel" refers to the arrangement of a color cam- 

era and a diffusely radiating source of illumination, while "reflection channel" 
refers to the arrangement of a black-and-white camera and a source of illumina- 
tion with a directed beam of light, while "overlay channel" refers to the arrange- 
ment according to the invention of a spectrally tuned shortwaved source of illumi- 

25 nation and a camera that serves for recognizing defects inside the transparent 
protective layer as well as for recognizing areas where the protective layer is 
completely absent. 

According to the preferred embodiment, cameras are employed to scan lami- 
nate floor coverings by an imaging technique. Naturally, the inventive idea is not 
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restricted to the use of cameras, but rather, it encompasses all types of imaging 
sensors, particularly also scanners that scan the laminate surface in a punctiform 
manner, so-called optical contact line sensors and other imaging sensors of the 
type known to the person skilled in the art of optics and image processing. 

5 Figure 1 shows a simplified form of a typical laminate structure having a sub- 

strate material 10 (in the case of floor laminates, usually a medium-density or 
high-density fiberboard and in the case of laminates made of plastic, a plastic film 
that is several millimeters thick). A paper or plastic film 11 whose surface 12 has 
the typical look, for example, of a wood structure, or is a marble or natural-stone 
10 imitation, is applied onto this substrate. This is followed by a transparent protec- 
tive layer 14, the so-called overlay film, which forms a hard, durable and 
abrasion-proof laminate surface. 

It is a known procedure, for example, to employ systems for inspecting 
ceramic tiles (CeraVision®, manufactured by MAS SEN machine vision systems 

15 GmbH) in order to detect defects in the decor by using a color camera and 
computer-aided color image evaluation. For this purpose, the surface is diffusely 
illuminated with a source of white light and the local color patterning is compared 
to color statistics previously acquired from a reference. This arrangement is 
referred to as "color channel". Such an arrangement is designated with the refer- 

20 ence numeral 16 in Figures 1 and 2. The source of white light has been given the 
reference numeral 18 and the color camera has the reference numeral 20. 

It is likewise a known procedure, for instance, from the inspection of ceramic 
tiles, to additionally illuminate the surface with a directed source of light and to 
make the observation with a black-and-white camera that detects the surface at the 

25 same angle. As a result, all of the defects on the surface of the protective layer are 
detected that either reflect the illuminating beam of light at an angle other than the 
angle of incidence (for instance, bumps or dents) or that reflect the beam of light 
at the same angle but with a different intensity (for example, places that are 
locally too dull or too glossy). This arrangement is referred to as "reflection chan- 

30 nel". Such an arrangement is indicated by the reference numeral 22 in Figures 1 
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and 2. The source of light has the reference numeral 24 and the black-and-white 
camera has the reference numeral 26. In this embodiment, the source of light 24 
and the black-and-white camera 26 are arranged at the same angle a relative to the 
surface of the laminate. 

5 Defects 30 inside the protective layer 14, as shown in Figure 2, are not recog- 

nized by the reflection channel 22 since the illuminating beam of light 32 is 
already reflected off the surface. Even localized absences of overlay (so-called 
overlay flaking) are often not recognized by the reflection channel 22, particularly 
in the case of laminates having a randomly embossed surface, which generates a 
10 high level of background noise. 

As a rule, typical defects 30 such as, for example, slight milkiness and melanin 
spots inside the protective layer 14, are likewise not recognized by the color cam- 
era 20 since these defects 30 only slightly change the local colors observed 
through the transparent protective layer 14, so that, in spite of these defects 30, 

15 these still match the color statistics previously acquired. Since many laminate sur- 
faces consist of random patterns and the printing of the decor film is created ran- 
domly by intentionally shifting the printing cylinders as well as by an intentional 
lack of synchronization among the individual inking units, it is not possible to 
make a direct image-to-image comparison, but rather, it is necessary to use the 

20 model of a statistical color pattern distribution. 

Therefore the prior-art surface-inspection methods are not capable of recog- 
nizing defects 30 inside the transparent protective layer 14. In the case of 
embossed laminates, even a completely absent overlay cannot be reliably recog- 
nized. 

25 According to the present invention, the laminate surface can be detected by 

imaging in such a way that defects 30 inside the transparent protective layer 14 
ranging all the way to the complete localized absence of the protective layer 14 
can be recognized with high reliability for both embossed and non-embossed 
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laminates. For this purpose, according to the invention, two different physical 
effects are utilized. 

As shown in Figure 3, the milkiness of the transparent protective layer 14 
(which results, for instance, from an inadequate compressing temperature and 
5 compressing force) can be described as a scatter model. The individual, non- 
transparent microscopic particles 30 scatter the penetrating light 36 and reflect a 
large fraction 38 back into the observing camera. If the microscopic particles 30 
are small in comparison to the wavelength X\ of the scattered light, as is the case 
here, the scatter inside a material rises by a power of four of the inverse value of 
1 0 the wavelength: 

I(scatter) ~ 1 A, 4 . 

Therefore, according to the invention, a source of illumination 40 having a 
wavelength range A,i is selected which is as shortwaved as possible. This is advan- 
tageously the blue region that directly follows the ultraviolet region that can no 

15 longer be detected by the camera. Preferably, the camera 42 that detects the back- 
scattered light 38 is equipped with an optical bandpass filter that only allows the 
passage of the wavelength range X\ of this range that is optimized with respect to 
the scatter inside the protective layer 14 and that blocks all extraneous light of a 
different color. Preferably, in order to detect the scatter, the camera 42 is arranged 

20 perpendicularly above the laminate and the illumination 40 is likewise arranged 
perpendicularly so as to minimize the effect of any embossing of the surface. 
According to the invention, the shortwaved source of illumination 36 is 
configured so as to be at least partially diffuse in order to minimize the optical 
effect on the detected scatter image caused by the surface embossing. 

25 With this method and this arrangement, all defects 30 inside and beneath the 

transparent protective layer 14 (in the example of the laminate floor covering of 
Figure 2, on the interface between the transparent protective layer and the printed 
paper or plastic film) can be detected that are due to scatter effects inside and 
beneath the transparent protective layer 14. Scattering particles beneath the pro- 
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tective layer can come, for example, from melanin residues that have remained 
between the transparent overlay film and the colored decor paper. 

Whereas scattering particles inside the transparent protective layer scatter back 
the penetrating, diffuse, shortwaved light, this effect also causes a widening of the 
5 image of a front-projected light line through a halo of light that grows with the 
scatter. This effect is referred to as "light halo effect" in the above-mentioned 
German patent specification DE 196 09 045 CI and is employed there to measure 
the local hardness of a wood surface. 

In a preferred embodiment of the method according to the invention, the light 
10 from the source of illumination by means of which the defects inside the trans- 
parent protective layer are to be detected is imaged in the form of a line on the 
surface of the transparent protective layer. The back scatter in the area of the 
defective places causes the line to widen in these areas. This widening is detected 
by the imaging sensor that is associated with this source of illumination such as, 
1 5 for instance, a black-and-white camera. Defective places can be ascertained in this 
manner. 

The complete absence of the transparent protective layer 14 cannot be detected 
with the scatter effect. Particularly in the case of embossed surfaces, this can 
likewise not be detected with the reflection channel 22 since the embossed surface 
20 generates a background noise that superimposes the difference between the gloss 
detected when a protective layer 14 is present and the lower gloss of the illumi- 
nated decor paper 12 when the protective layer 14 is absent. 

According to the invention, as shown in Figure 4 5 the fluorescence of the pro- 
tective layer 14 is utilized for this purpose. In order to do so, the surface is irradi- 
25 ated with shortwaved light from a source of illumination 46 whose wavelength 
range X\ is at the lower end of the sensitivity of the observing camera. The fluo- 
rescence of the intact protective layer 14 gives rise to a back-scattered light having 
a larger wavelength X 2 that lies in the more sensitive range of the observing cam- 
era. The protective layer 14 thus appears as slightly bright. 
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Absent places 50, so-called overlay flaking, are, in contrast, dark since the 
reflecting decor paper 52 does not exhibit any fluorescent properties and therefore 
the back-scattered light has the same wavelength X\ as the light emitted by the 
source of illumination 46. 

5 Absent places of the transparent protective layer can also be recognized in that 

the shortwaved light emitted by the source of illumination is imaged in the form 
of a line on the surface to be inspected. In areas where the surface having a color 
pattern is covered by the transparent protective layer, the fluorescent light emitted 
by the protective layer alters the image of the line projected onto the surface. If 
10 the sensitivity of the detecting camera in the range of the fluorescent light is 
greater than in the range of the exciting light, the line appears brighter in areas 
that are covered by the protective layer than in areas that are not covered by the 
protective layer. 

Preferably, so-called black-light lamps which have an ultraviolet fraction that 
15 excites the fluorescence of the protective layer and which also emit a shortwaved 
visible fraction are employed to illuminate the laminate surface. In this manner, a 
single source of illumination and a single camera 41 (also see Figure 6a) can use 
the localized higher scatter to recognize the milkiness defects inside the 
transparent protective layer as bright image places, and they can use the localized 
20 absence of fluorescence to recognize the localized absence of the transparent pro- 
tective layer as dark image places on the overall slightly bright background. 

Figure 5 schematically shows the spectrum S(k) of the source of illumination 
41 together with the sensitivity characteristic line E of the camera, which are 
necessary to detect defects 30 inside the protective layer 14 ranging all the way to 
25 the complete absence of the protective layer 14 through the simultaneous use of 
scatter and fluorescence. 

The shortwaved black-light source of illumination has, for example, the 
spectral emission characteristic line that is centered around the medium 
wavelength A4. The observing black-and-white camera has a sensitivity 
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characteristic line E that ranges from shortwaved blue all the way to red. For the 
sake of simplicity, this characteristic line E is considered to be constant up to the 
important rising branch at 350 nm. 

The fluorescence of the protective layer 14 shifts the spectral wavelengths that 
5 are invisible or less sensitive for the camera into the range of higher sensitivity of 
the camera, as indicated by the arrow 56. The intact protective layer appears here 
as slightly bright and the absent protective layer appears dark. The scatter caused 
by milky melanin particles in the protective layer enlarges the reflection in the 
shortwaved violet-blue of the source of illumination, as indicated by the arrow 58. 
10 Consequently, melanin spots and slight milkiness appear as markedly brighter 
zones. 

Figure 6a shows by way of an example an arrangement according to the 
invention of the three image channels, namely, the "color channel" 16, the 
"reflection channel" 32 and the "overlay channel" 60. The optical insulation 

15 between the color channel 16 and the other two channels 32 and 60, respectively, 
is achieved by a shielding 62 of the diffuse white light. In order to keep the 
installation dimensions on the production line as small as possible, according to 
the invention, the optical insulation of the reflection channel 32 and the overlay 
channel 60 is achieved by a spectral separation of the reflection illumination and 

20 the overlay illumination. The directed source of illumination 24 of the reflection 
channel 32 is configured for a wavelength range X 3 (also see Figure 6b) that does 
not intersect with the shortwaved range X4 of the source of illumination 41 of the 
overlay channel 60. 

Consequently, X, 3 is preferably moved into the red or near-infrared range. At 
25 the same time, the camera 26 of the reflection channel 32 is equipped with an 
optical bandpass filter having the same pass-band A* in order to become insensi- 
tive to the illumination of the overlay channel. Analogously, the camera 42 of the 
overlay channel 60 is equipped with an optical filter having the pass-band 
which only allows the shortwaved back refraction and fluorescence to pass 
30 through. These conditions are once again depicted in the spectral diagram of 
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Figure 3b, whereby the sensitivity characteristic line is divided in accordance with 
the emitted spectrum into two parts El and E2, each corresponding to the 
appertaining sensitivity range El or E2 of the camera 42 of the overlay channel 60 
and of the camera 26 of the reflection channel 32. 

5 According to the invention, this spectral separation brings about two decisive 

advantages: the geometrical installation dimensions are markedly reduced and the 
two channels, namely, "reflection" and "overlay" observe the same place of the 
laminate. Consequently, their image signals can be combined in the manner of 
multisensorial and multidimensional signal processing to form a 2-channel image 

10 signal and they can be evaluated by means of the method of multidimensional 
pattern recognition. This multidimensional image processing has already been 
described in the above-mentioned German patent specification DE 196 09 045 CI. 

The explanation of the inventive idea on the basis of smooth wood laminate 
surfaces and the use of cameras do not mean that the inventive idea is limited to 

1 5 these materials and these imaging means. It is obvious for the person skilled in the 
art of image processing to employ this inventive idea and the arrangement for 
other colored surfaces consisting of other materials with transparent protective 
layers which can be smooth as well as not smooth and also to employ imaging 
means other than cameras. The present invention can likewise be employed for 

20 optical surface inspection systems with 3D-channels, X-ray channels and the like, 
which inspect surfaces that are provided with transparent protective layers. 



